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PROGRAMMABLE CIRCUIT AND RELATED COIWPUTiNG MACHINE AND 

METHOD 

Claim of priority 

[1] This application claims priority to U.S. Provisjonal Application Serial 

5 No. 60/422,503, filed on October 31, 2002, which is incorporated by reference. 

Cross reference to related APPUCArroNS 

J2] This application is related to U,S, Patent App> Ser. Has. 10/684,102 

entified tM PROVED COMPUTSNG ARCHITECTURE AND RELATED SYSTEM AND 
METHOD, 10/684,053 entitled COMPUTING MACHiNE HAVING IMPROVED 

10 COMPUTING ARCHITECTURE AND RELATED SYSTEM AND METHOD; 

10/683,929 entitled PIPELINE ACCELERATOR FOR IMPROVED COMPUTING 
ARCHITECTURE AND RELATED SYSTEM AND METHOD and 10/683,932 entitled 
PIPELINE ACCELERATOR HAVING MULTIPLE PIPELINE UNfTS AND RELATED 
COMPUTING MACHINE AND METHOD, ail fifed on October 9, 2003, and having a 

1 5 common owner, and which are incorporated by reference. 

Background 

|3] A common computing architecture for processing relatlveiy large 

amounts of data in a relatively short period of time includes multiple interconnected 
processors that share the processing burden. By sharing the processing burden, 
20 these multiple processors can often process the data more quickly than a singie 

processor can for a given clock frequency. For example, each of the processors can 
process a respective portion of the data or execute a respective portion of a 
processing algorithm. 

f43 FIG, 1 is a schematic block diagram of a conventional computing 

25 machine 10 having a multi-processor architecture. The machine 10 includes a 
master processor 12 and coprocessors 14i-14m which communicate with each 
other and the master processor via a bus 16, an input port f S for receiving raw data 
from a remote device (not shown in FIG- 1), and an output port 20 for providing 
processed data to the remote source* The machine 10 also inctudes a memory 22 
30 for the master processor 12, respective memories 24f - 24n for the coprocessors 14i 
- 14„, and a memory 26 that the master processor and coprocessors share via the 
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bus 16. The memory 22 serves as both a program and a working memory for the 
master processor 12, and each memory 24i - 24^ serves as both a program and a 
working memory for a respective coprocessor 14i - 14rt. The shared memory 2B 

allows the master processor 12 and the coprocessors f 4 to transfer data among 
5 themseives, and from/to the remote device via the ports tS and 20, respectrvely. 
The master processor 12 and the coprocessors 14 also receive a common clock 
signal that controls the speed at which the machine 10 processes the raw data. 

[53 In general, the computtng machine 10 effectivefy divides the 

processing of raw data among the master processor 12 and the coprocessors 14. 

10 The remote source (not shown in FIG. 1) such as a sonar array loads the raw data 
via the port 1S into a section of the shared memory 26, which acts as a 
first-in-flrst-oot (FIFO) buffer (not shown) for the raw data. The master processor 12 
retrieves the raw data from the memory 26 via the bus f 6, and then the master 
processor and the coprocessors 14 process the raw data, transfernng data among 

15 themselves as necessary via the bus 16. The master processor 12 ioads the 

processed data into another FFO buffer (not shown) defined in the shared memory 
26> and the remote source retrieves the processed data from this FIFO via the port 
20. 

l&i In an example of operation, the computing machine 10 processes the 

20 raw data by sequentiaily performing n + 1 respective operations on the raw data, 
where these operations together compose a processing algorithm such as a Fast 
Fourier Transform (FFT). f^ore specifically, the machine forms a data-processing 
pipeline from the master processor 12 and the coprocessors 14. For a given 
frequency of the clock signal, such a pipeline often allows the machine 10 to process 
25 the raw data faster than a machine having only a singie processor. 

[7] After retrieving the raw data from the raw-data FIFO (not shown) in the 

memory 26, the master processor 12 performs a first operation, such as a 
trigonometric function, on the raw data- This operation yields a first result, which the 
processor 12 stores in a first-result FIFO (not shown) defined within the memory 26. 
30 Typicafly, the pnocessor 12 executes a program stored in the memory 22, and 
performs the above-described actions under the control of the program. The 



2 
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processor 12 may a!so use the memory 22 as working memory to temporanfy store 
data that the processor generates at intemiediate intervals of the first operatiort. 

[8] Next, after retrieving the first result from the first-resuit FIFO (not 

shown) in the memory 26, the coprocessor f 4| performs a second operation, such 
5 as a fogarithmic function, on the first result. This second operation yields a second 
result, which the coprocessor 14i stores in a second^result FIFO (not shown) defined 
within the memory 26. Typicaiiy* the coprocessor 14i executes a program stored in 
the memory 24f, and performs the above-described actions under the control of the 
program. The coprocessor 14i may also use the memory 24i as working memory to 
10 temporarily store data that the coprocessor generates at intermediate intervals of the 
second operation. 

19] Then, the coprocessors 242 - 24n sequantjalSy perform third - tf^ 

operations on the second - (n-1 results In a manner similar to that discussed 
above for the coprocessor 24f , 

15 |10J The n^^ operation, which is performed by the coprocessor 24nt yields 

the final result, Lb., the processed data. The coprocessor 24n loads the processed 
data into a processed-data FIFO (not shown) defined within the memory 26, and the 
remote device (not shown in FIG. 1) retrieves the processed data from this FIFO- 

111] Because the master processor 12 and coprocessors 14 are 

20 simuitaneousiy performing different operations of the processing atgorithm, the 

computing machine 10 is often able to process the raw data faster than a computing 
machine having a single processor that sequentiaOy performs the different 
operations. Specrfically, the single processor cannot retrieve a new set of the raw 
data untii it performs all n 1 operations on the previoys set of raw data. But using 
25 the pipeline technique discussed above, the master processor 12 can retrieve a new 
set of raw data after performing only the first operation. Consequently, for a given 
clock frequency, this pipeline technique can increase the speed at which the 
machine 10 processes the raw data by a factor of approximately n + 1 as compared 
to a single-processor machine (not shown in FIG. 1). 

30 £12] Afternatively, the computing machine 10 may process the raw data in 

parallel by simultaneoysly performing n ^ 1 instances of a pnocessing aigorithm. 
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such as an FFT, on the raw data. That is, ff the algorithm Includes i sequential 
operations as described above In the previous example, then each of the master 
processor 12 and the coprocessors 14 sequentially perform alt n 1 operations on 
respective sets of the raw data< ConsequentSy, for a given cSock frequency, this 
5 paraltel-processing technique, like the above-described ppelioe technique, can 
increase the speed at which the machine 10 processes the raw data by a factor of 
approximately n 4- 1 as compared to a slngle-pmcessor machine (not shown in FIG. 
1). 

J13] Unfortunately, although the computing machine 10 can process data 

10 more quickly than a single-processor computing machine (not shown in FIG. 1 ), the 
data-processtng speed of the machine 10 is often significantty leas than the 
frequency of the processor clock. Specifically, the data-processing speed of the 
computing machine 10 is limited by the time that the master processor 12 and 
coprocessors 14 require to process data. For brevity, an example of this speed 

15 limitation is discussed in conjunction with the master processor 12, although it is 
understood that this discussion also applies to the coprocessors 14. As discussed 
above, the master processor 12 executes a program that controls the processor to 
manipulate data m a desired manner. This program indudes a sequence of 
instructions that the processor 12 executes. Unfortunatefy, the processor 12 

20 typically requires multiple clock cydes to execute a singie instruction, and often must 
execute multiple instructions to process a single vaiue of data. For example, 
suppose that the processor 12 is to multiply a first data value A (not shown) by a 
second data value B (not shown). During a first dock cycle, the processor 12 
retrieves a multiply instruction from the memory 22. During second and third clock 

25 cycles, the processor 12 respectively retrieves A and B from the memory 26. During 
a fourth clock cycle, the processor 12 multiplies A and B, and, during a fifth clock 
cycle, stores the resulting product in the memory 22 or 26 or provides the resulting 
product to the remote device (not shown). This is a best-case scenario, because in 
many cases the processor 12 requires additlonat clock cycles for overhead tasks 

30 such as inittaiizing and closing counters. Therefore, at best the processor 12 
requires five clock cycles, or an average of 2,5 clock cycles per data value, to 
process A and B,. 
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[14J Consequently, the speed at which the computing machine 10 

processes data is often sigoificantfy lower than the frequency of the clock that drives 
the master processor 12 and the coprocessors 14. For example, if the processor 12 
is ciocked at 1.0 Gigahertz (GHz) but requires an average of 2.5 clock cycles per 
5 data vafue, then the effective data-processing speed equals (1.0 GHz)/2,5 ^ 0.4 
GHz* This affective data-processing spaed Is often characterized in units of 
operations per second. Therefore, in this exampte, for a clock speed of 1 ,0 GHz, the 
processor 12 vyould be rated with a data-processing spaed of 0-4 
Gigaoparations/second (Gops). 

10 [15] FIG. 2 is a block diagram of a hardwired data pipeline 30 that can 

typically process data faster than a processor can for a given cfock frequency, and 
often at substantSaliy the same rate at which the pipeiine is docked. The pipeline 30 
includes operator circuits 32i - 32n. which each perform a respective operation on 
respective data without executing program instructions. That is, the desired 

15 operation is "bumed in" to a circuit 32 such that It implements the operation 

automaticaily, without the need of program instructions. By eliminating the overhead 
associated with executing program instructions^ the pipeline 30 can typicaily perform 
more operations per second than a processor can for a given clock frequency. 

|1 6] For example, the pipeline 30 can oten solve the foliowing equation 

20 faster than a processor can for a given clock frequency: 

where Xk represents a sequence of raw data values. In this example, the operator 
circuit 32i is a multiplier that calculates 5xk. the circuit 322 is an adder that calculates 
Sxk-^ 3, and the circutt 32^ (n = 3) is a multiplier that calculates (5x^ ^ 3)2^*'\ 

25 [171 During a first clock cycle k=1 , the circuit 32 f receives data value Xi and 

multiplies it by 5 to generate 5xi, 

[18] During a second clock cycle k - 2, the circuit 32^ receives 5xi from the 

circuit 32f and adds 3 to generate 5xi 3. Also, during the second dock cycle, the 
circuit 32i generates Sxa, 

30 ^^^^ During a third clock cycle k = 3, the circuit 32^ receives 5xi + 3 from the 

circuit 32z and multiplies by 2^^ (effectively left shifts 5xi ^ 3 by Xi ) to generate the 



wo 2004/*>4256?> 



l>CTAJS2003/034556 



first result {5xi 4. z)2''\ Also during the third dock cycle, the circuit 32^ generates 5x3 
and the circuit 322 generates 6x3 + 3> 

[20| The pipeline 30 continues processing subsequent raw data values Xr in 

this manner unti! all the raw data values are processed- 

5 [21| Consequentiy, a delay of two clock cycles after receiving a raw data 

value Xt — this deiay is often calied the latency of the pipeline 30— the pipeline 
generates the result (5xi f 3)2^1, and thereafter generates one result — e.g., (6x2 *^ 
3)2^, (5X3 ^ 3)2^^, .... 5xn ^ 3)2''*' — each dock cycle, 

[22] Disregarding the latency, the pipeline 30 thus has a data-processing 

10 speed equa! to the clock speed. In companson, assuming that the master processor 
f 2and coprocessors 14 (PiG. 1) have data-pracessing speeds that are 0.4 times the 
dock speed as in the above example, the pipeiine 30 can process data 2,5 times 
faster than the computing madiine 10 (FIG, 1) for a given clock speed, 

[23] Still referring to FIG* 2, a designer may choose to implement the 

15 pipeiine 30 in a programmable iogic IC (PLIC), such as a field-programmable gate 
array (FPGA)> because a FLIC allows more design and modification flexibiiity than 
does an appfication specific IC (ASiC). To configyre the hardwired coonections 
within a PLIC, the designer merely sets interconnection-configuration registers 
disposed within the PLIC to predetermined binary states. The combination of al! 
20 these binary states is often called ^tirmware." Typicaily, the designer loads this 

firmware into a nonvofatile memory (not shown in FIG- 2) that is coupled to the PLfC> 
When one "turns on" the PLIC, it downloads the firmware from the memory into the 
interconnectton-configu ration registers. Therefore, to modify the functioning of the 
PLIC, the designer merely modifies the firmware and allows the PLIC to download 
25 the modified firmware into the interconnection-configu lotion registers. This ability to 
modify the PLIC by merely modilying the firmware is partfculariy useful during the 
prototyping stage and for upgrading the pipeline 30 in the Held"* 

{24} Uofortunateiy, the hardwired pipeline 30 may not be the best choice to 

execute algorithms that entaii significant decision making, partiGulariy nested 
30 decision making. A processor can typicafly execute a nested-decision-making 

{nstftiction (e.g., a nested conditional instruction such as "if A, then do B, else if C, 
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do D, * . 0iB0 do n") approxtmateiy as fast as it can execute an operattonal 
Instruction (e.g., **A B'') of comparabfe lengtli. But aitttough the pipeline 30 may be 
able to make a relatively simple decision (e.g., "A > B?"") effictentiy, it typically cannot 
execute a nested decision (e.g., "if A, tiien do B, else if C, do D, . . else do n") as 
5 efficiently as a processor can. One reason for this Inefflciency Is that the pipeline 30 
may have little on-board memory, and thus may need to access external 
working/program memory (not shown). And although one may be able to design the 
pipeline 30 to execute such a nested decision, the size and complexity of the 
required circuitry often makes such a design irnpractica!, particularly where an 
1 0 algorithm includes multlpie different nested decisions. 

|25] Consequently, processors are typically used m applications that require 

significant decision making, and hardwired pipelines are typically limited to "number 
crunching'' applications that entail little or no decision making. 

{261 Furthermore, as discussed below, it is typically much easier for one to 

1 5 design/modify a processor-based computing machine, such as the computing 
machine f 0 of FIG* 1 , than it is to design/modify a hardwired pipeline such as the 
pipeline 30 of FIG* 2, partlcuiariy where the pipeiine 30 includes multiple PLICs. 

[27] Computing components, such as processor and their peripherafs 

(e.g., memoi^), typically include industry-standard communication interfaces that 

20 fecititate the interconnection of the components to form a processor-based 
computing machine. 

[283 Typlcaliy, a standard communication Interface inciudes two layers: a 

physical layer and a services layer. 

|293 The physica! layer Includes the circuitry and the corresponding circuit 

25 interconnections that form the communication interface, and the operating 

parameters of this circuitry. For example, the phystoal layer includes the pins that 
connect the component to a bus, the buffers that latch data received ffom the pins, 
the drivers that drive aignais onto the pins, and circuitry for recovering data from an 
input data signal and for recovering a clock signal from the data signal or from an 
30 external clock signal. The operating parameters include the acceptable voltage 
range of the data signals that the pins receive, the signai timing for writing and 



7 



wo 2004/042569 



.PCT/ljS2W3/034556 



reading data, and the supported modes of operation (e.g., burst mode, page mode). 
Conventional physicai layers jncfude transistor-transistor logic (TTL) and RAM BUS. 

[30} The services layer includes the protocoi by which a computing 

component transfers data. The protocol defines the format of the data and the 
6 manner in which the component sends and receives the formatted data. 

Conventional communication protocols include file-transfer protocol (FTP) and 
transmission control protocol/internet protocoi (TCP/IP). 

[31 1 Conseqoently, because manufacturers and others typically design 

computing components having industry-standard communication interfaces, one can 
1 0 typically design the interface of such a oomponent and interconnect it to other 

computing components with relatively little effort. This aiSovvs one to devote most of 
his time to designing the other portions of the computing machine, and to easily 
modify the machine by adding or removing components. 

[32| Designing a computing component that supports an lndustry*standard 

16 communication interface allows one to save design time by using an existing 

physicaHayer design from a design Hbrary, This also Insures that he/she can easily 
interface the component to off-the-shelf computing components* 

[33| And designing a computing machine using computing components that 

support a common industry-standard communicetton interface allows the designer to 

20 interconnect the components with little time and effort. Because the components 
support a common interface, the designer can interconnect them via a system bus 
with little design effort- And because the supported interface is an Industry standard, 
one can easily modify the machine. For example* one can add different components 
and peripherals to the machine as the system design evolves, or can easily 

25 add/design next-generation components as the technology evolves. Furthermore, 
because the components support a common industry-standard services layer, one 
can incofporate into the computing machine's software an existing software module 
that Implements the corresponding protocol Therefore, one can interface the 
components with little effort because the interface design is essentially already in 

30 place, and thus can focus on designing the portions (e.g., software) of the machine 
that cause the machine to perform the desired fu notion (s). 
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[34] But unfortunately, there are no known industry-standard services layers 

for components, such as PLiCs, used to form hardwired pipelines such as the 
pipeline 30 of FIG. 2. 

[35] Consequently, to design a pipeiine having multiple PLICs» one typioatiy 

5 spends a significant amoynt of time and exerts a significant effort designing "from 
scratch" and debugging the services layer of the communication interface between 
the PLfCs. Typically, such an ad hoc services layer depends on the parameters of 
the data being transferred between the PLfCs, Likev^ise, to design a pipeline that 
interfaces to a processor, one would have to spend a significant amount of time and 
10 exert a significant eflbrt in designing and debugging the services layer of the 
communication interface between the pipefine and the processor. 

136] Similarly, to modify such a pipeiine by adding a PLfC to it one typically 

spends a significant amount of time and exerts a significant effort designing and 
debugging the services layer of the communication interface between the added 
15 PUC and the existing PLICs. Likewise, to modify a pipeline by adding a processor, 
or to modify a computing machine by adding a pipeline, one would have to spend a 
signtficant amount of time and exert a significant effort in designing and debugging 
the services layer of the communication interface between the pipeline and 
processor. 

20 [37] Consequently, referring to FIGS. 1 and 2, because of the difflcuities in 

interfacing multiple PLlCs and in interfacing a processor to a pipeiine, one ts often 
forced to make significant tradeoffs when designing a computing machine. For 
exampie. with a processor-based computing machine, one is forced to trade number- 
cmnching speed and design/modification flexibility for complex decision-making 

25 ability. Conversely, with a hardwired pfpeljoe-based computing machine, one Is 

forced to trade complex-dectsion-making ability and design/modification iexibility for 
number-cnjnching speed. Furthermore, because of the difficuities in interfacing 
multiple PLICs, ft is often impractical for one to design a pipeline-based machine 
having more than a few PLfCs, As a result, a practicai pipeline-based machine often 

30 has Nmited functionaiity. And because of the difficulties in Interfacing a processor to 
a PLIC, It would be impractical to interface a processor to more than one PLIC- As a 



wo 2004/*>4256?> 



l>CTAJS2003/034556 



result, the benefits obtained by combining a procesaor and a pipeline would be 
minimal 

[38J Therefore, a need has arisen for a new computing architecture that 

ailows one to combine the decision-making ability of a processor-based machine 
with the number*crunchlng speed of a hardwired-pipellne^based machine, 

SUSiMARY 

[39] According to an embodiment of the invention, a programmabie circuit 

receives firmware from an external source, stores the firmware in a memory, and 
then downioads the firmware from the memory* 

|40} Such a programmable circuit aliows a system, such as a computing 

machine, to modify a programmable circuit's configuration, thus eliminating the need 
for manually reprogramming the configuration memory. For exampfe, if the 
programmabie circuit is an FPGA that is part of a pipeftne acceierator, a processor 
coupled to the acceierator can modify the configuration of the FPGA. More 
specifically, the processor retrieves from a configuration registry firmware that 
represents the modified configuration, and sends the firmware to the FPGA, which 
then stores the firmware in a memory such as an etectncaliy erasable and 
programmable read-only memory (EEPROM). Next, the FPGA downioads the 
firmware from the memory into its configuration registers, and thus effectively 
reconfigures itself to have the modified configuration. 

Brief Description of the Drawings 

[41] FIQ« 1 is a block diagram of a computing machine having a 

conventional multi-processor architecture, 

[42] FIG, 2 is a block diagram of a conventional hardwired pipeline. 

C43] FIG. 3 is a block diagram of a computing machine having a peer-vector 

architecture according to an embodiment of the inventton. 

[441 FIG, 4 is a block diagram of a pipeline unit of the pipeline accelerator of 

FIG. 3 according to an embodiment of the invention. 

£45] FIG. 5 is a diagram of a logical parlftlonlng of the firmware memory of 

flG. 4 according to an embodiment of the invention, 

10 



wo 2004/*>4256?> 



l>CTAJS2003/034556 



E46| FIG. 6 is a btock diagram of a pipeline unit of the pipeline acceierator of 

FIG, 3 according to another embodiment of the invention . 

Detailed Descrji^tjom 

[47] FIG, 3 is a schematic block diagram of a computing machine 40, which 

5 has a peer-vector architecture accotxJing to an embodiment of the invention. !n 
addition to a host processor 42, the peer-vector machine 40 includes a pipeline 
accelerator 44, which performs at least a portion of the data processing, and which 
thus effectlveiy replaces the bank of coprocessors 14 in the computing machine 10 
of FIG. 1> Therefore, the host-prDcessor 42 and the accelerator 44 (or pipeHne units 

10 thereof, as discussed below) are "peers" that can transfer data vectors back and 

forth. Because the acceierator 44 does not execute program instructions, it typically 
performs mathematically intensive operations on data significantly faster than a bank 
of coprocessors can for a given clock frequency. Consequently, by combining the 
decision-making ability of the processor 42 and the number-crunching ability of the 

15 accelerator 44, the machine 40 has the same abitities as, but can often process data 
faster than, a conventional computing machine such as the machine 10. 
Furthermore, as discussed below, providing the accelerator 44 with a communication 
interface that is compatible with the communication interface of the host processor 
42 facilitates the design and modification of the machine 40, partloulariy where the 

20 processor's communication interface is an industry standard- And where the 
accelerator 44 indudes one or more PLiCs, the host processor 42 can hard 
configure physical interconnectors within the accelerator by sending appropriate 
firmware to these PLlCs. The host processor 42 may not only configure the 
acceierator 44 in this manner during initialization of the peer-vector machine 40, but 

25 it may have the ablHty to reconigure the accelerator during operation of the 

peer-vector machine as discussed below and in previously dtad U.S. Patent App. 
Seriai No, 10/684,053 entitled COMPUTING IVIACHtNE HAVING iMPROVED 
COMPUTiNG ARCHtTECTURE AND RELATED SYSTEM AND METHOD, 
yoreover, the peer-vector machine 40 may also provide other advantages as 

30 described below and in the previously cited patent appiications, 

[481 Still referring to FIG* 3, in addition to the host processor 42 and the 

pipeline accelerator 44. the peer-vector compyting machine 40 includes a processor 
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memory 46, an interface memory 4B^ a pipeline bus 50, one or more firmware 
memories 52, an optlona! raw-data Input port 54, a processed-data output port 58, 
an optional router 61, and a test bus 63, 

[40] The host processor 42 inciydes a processing unit 62 and a message 

5 handler 64* and the processor memory 46 mcludes a processing-unit memory 66 
and a handler memory 68, which respecilveiy serve as both program and working 
memories for the processor unit and the message handier The processor memory 
46 also includes an accelerator-configuration registry 70 and a 
message-configuration registry 72, which store firmware and configuration data that 

10 respectively allow the host processor 42 to configure the functioning of the 

accelerator 44 and the format of the messages that the message handier 64 sends 
and receives- The configuration of the accelerator 44 and the message handler 64 is 
fijrt her discussed in prevtousfy cited U,S, Patent App. Serial No, 10/684,053 entitied 
COMPUTING MACHINE HAVING fMPROVED COMPUTING ARCHfTEGTURE AND 

15 RELATED SYSTEM AND METHOD, and the configy ration of the accelerator 44 is 
also further discussed beiow In con|unction with FIGS* 4'^. 

[501 The pipeline accelerator 44 Is disposed on at least one PLiC (FIG- 4} 

and includes hardwired pipelines 74i 74^, which process respective data without 
executing program instructions. The firmware memory 52 stoms the firmware for the 

20 accelerator 44. More specifically, the firmware memory 52 stores the firmware for 
the PLlCs that compose the acceierator 44 as discussed further below in conjunction 
with FIGS. 4 - 6, Alternatively, the accelerator 44 may be disposed on at least one 
ASIC, and thus may have internal interconnections that are unconfigurablo once the 
ASiC IS formed, in this alternative where the acceierator 44 jndodes no PLiCs, the 

25 machine 40 may omit the firmware memory 52. Furthermore, although the 

accelerator 44 is shown including multiple pipelines 74^-'74m it may include only a 
single pipeiine. In addition, aithough not shown, the accelerator 44 may include one 
or more processors such as a digital-signaf processor (DSP), Moreover, although 
not shown, the accelerator 44 may Include a data input port and/or a data output 

30 port. 

[S13 The general operation of the peer-vector macWne 40 is discussed in 

previously cited U.S. Patent App. Serial No, 10/684,102 entitled iMPROVED 
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COMPUTING ARCHITECTURE AND RELATED SYSTEM AND METHOD, the 
sfructure and operation of the host processor 42 Is discussed In previously cited U.S. 
Patent App. Serial No. 10/684,063 entitled COMPUTING MACHINE HAVING 
IMPROVED COMPUTING ARCHITECTURE AND RELATED SYSTEM AND 
METHOD, and the stmcture and operation of the pipeline accelerator 44 is 
discussed in previously cited U.S. Patent App. Serial Nos. -10/683,929 entitled 
PIPELINE ACCELERATOR FOR IMPROVED COMPUTING ARCHITECTURE AND 
RELATED SYSTEM AND METHOD and 10/683,932 entttied PIPELINE 
ACCELERATOR HAVING MULTIPLE PIPELINE UNITS AND RELATED 
COMPUTING MACHINE AND METHOD. The operating configurations of the PLlCs 
that comfrtjse the accelerator 44 are discussed in previously cited U.S. Patent App. 
Serial No. 10/683,929 entitled PIPELINE ACCELERATOR FOR IMPROVED 
COMPUTING ARCHITECTURE AND RELATED SYSTEM AND METHOD and 
below In conjunction with FIGS. 4-6. 

C52| Referring to FIGS. 4-6, techniques for "hard" conjuring the 

accelerator 44 PLiCs are discussed. As alluded to above, the hard configuration of a 
PLIC is programmed by flrnnware and denotes the specific physical interconnections 
among the components of the PLIC, /.©., how one logic block is electrically 
connected to another logic block. This is in contrast to the "soft" configuration, which 
denotes a higher-level configuration of an already-hard-conflgured PLIC. For 
example, a hard-configured PLIC may include a buffer, and may also include a 
register #iat allows one to soft configure tfie size of the buffer by loading 
corresponding soft-configuration data into the register. Soft configuration of the 
accelerator 44 is further discussed in previously cited U.S. Patent App. Serial Nos, 
10/684,053 entitled COMPUTING MACHINE HAVING IMPROVED COMPUTING 
ARCHITECTURE AND RELATED SYSTEM AND METHOD and 10/683.929 entitled 
PIPELINE ACCELERATOR FOR IMPROVED COMPUTING ARCHITECTURE AND 
RELATED SYSTEM AND METHOD. 

FIG. 4 is a block diagram of a pipeline unit 78 of the pipeline 
accelerator 44 of FIG. 3 according to an embodiment of the invention. The 
hardwired pipelines 74i - 74„ (FIG. 3) are part of the pipeline unit 75, which, as 
discussed below, includes circuitry that, e.g., controls the hardwired pipelines and 

13 
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aI!ov\^ them to receive, send, and store data. Although only one pipeline unit 78 le 
shown In FIG. 4. tiie accelerator 44 may indude multiple pipeline units (each 
including at least some of the hardwired pipelines 74i - 74„) as discussed in 
previously cited U.S. Patent App. Serial No. 10/683,932 entitled PIPELINE 
ACCELERATOR HAVING MULTIPLE PIPELINE UNITS AND RELATED 
COMPUTING MACHINE AND METHOD. As discussed below, in one 
implementation, the hard configuration of the pipeline unit 78 is programmable with 
firmware. This allows one to modify the functioning of the pipeline unit 78 by merely 
modifying the firmware. Furthermore, the host processor 42 (FIG. 3) can provide the 
modified firmware to the pipeline unit 78 during an initfatization or reconfiguration of 
the peer-vector machine 40 (FIG- 3), and thus can eliminate the need for one to 
manually load the modified firmware into the pipeline unit 

[54] The pipeline unit 78 includes a pipeline circailt 80, such as a PLIC or an 

ASIC, the finnware memory 52 (where the pipeline circuit is a PLIC), and a data 
memory 81, which may all be disposed on a circuit board or card 83, The data 
memory SI is further discussed in previously cited U.S. Patent App. Serial No. 
10/684,057 entttled PROGRAMMABLE CIRCUIT AND RELATED COMPUTING 
MACHINE AND METHOD, and the combination of the pipeline circuit SO and the 
firmware memory SJ? forms a programmable-circuit unit, 

[55] The pipeline circuit 80 includes a communiGation interface 82, which 

transfers data between a peer, such as the host processor 4Z (FIG. 3), and the data 
memory 81, and also between the peer and the following other components of the 
pipeline circuit: Itie hardwired pipelines 74i-74„ via a communication sheil 84, a 
pipeline controller 86, an exception manager 88, and a configuration manager 90, 
The pipeline circuit 80 may also Include an industry-standard bus interface 91 and a 
communication bus S3, which connects the interface 82 to the interface 91. 
Alternatively, the functionality of the interface 91 may be included within the 
communication interface 82 and the bus 93 omitted. The structure and operation of 
the hardwired pipelines 74i-74n, controtler 86, exception manager 88, configuration 
manager 90, and bus interface 91 are discussed in previously cited U.S. Patent App. 
Serial No. 10/683,929 entitled PIPELiNE ACCELERATOR FOR IMPROVED 
COMPUTING ARCHITECTURE AND RELATED SYSTEM AND METHOD, 
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[56] The communication interface 82 sends and receives (via the bus 

interface 91 where present) data in a format recognized by the message handler 64 
(FIG* 3), and thus typically facilitates the design and mod rfication of the peer-vector 
machine 40 (FfG. 3). For exampfe, if the data format m an industry standard such as 
5 the Rapid !/0 format, then one need not design a custom interface between the host 
processor 42 and the pipeline unit 78 . Furthemiore, by aliowing the pipeime unit 78 
to communicate with other peers, such as the host processor 42 (FfG. 3), via the 
pipeline bus 50 instead of via a non-bus Interface, one can change the number of 
pipeline units by merely connecting or disconnecting them (or the circuit cards that 
10 hoid them) to the pipeline bus instead of redesigning a non«bus interface from 
scratch each time a pipeline unit is added or removed. 

|57] Where the pipeline circuit 80 is a PLfC such as an FPGA, the 

communication interface 8% includes a programming port 94, which aliows the 
pipeline circuit to load fim^ware from the host processor 4Z (FIG, 3) into the firmware 
15 memory 52 as discussed below. For example, if the firmware memory 52 is an 
EEPROM, then during a programming cycle the communication interface 82 
generates, and the port 94 deiivers, the programming signals that the firmware 
memory requires. Circuitry for generating such programming signals is conventional 
and thus is not discussed further. 

20 |58] The structure and operation of the communication interface 82 is 

further discussed in previously cited U.S. Patent App. Serial No. 10/683,929 entitled 
PIPEUNE ACCELERATOR FOR IMPROVED COMPUTING ARCHITECTURE AMD 
RELATED SYSTEM AND METHOD, 

[59] Still referring to FIG. 4, the pipeline circuit 80 also includes a test port 

25 96, and, where the pipeline circuit is a PLIC, a ha rd-oonfigu ration port 98. The test 
port 96, which is coupled to the test bus 63, allows the host processor 42 (FIG. 3) to 
monitor the resuits of a self test that the pipeline circuit SO may perform during 
initialization of the peer-vector machine 40 (FtG. 3) as discussed below. The 
manufacture typically includes the test port 96 with the pipeline circuit 80, and 
30 typicaily provides the test port with an interface (not shown) that Is compatible with 
an Industry-standard test protocol such as JTAG, The hard-configuration port 98 
allows the pipeline circuit 80 to configure itseif by downloading firmware from the 
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memory 52 as discussed befow- Like tlie test port 96, the manufacture typically 
includes the configuration port 98 with the pipeline drcuft 80, and typically provides 
the configuration port with an Industry-standard memory interface and state machine 
(neither shown) that serially downloads the firmware from a predetermined address 
5 range of the memory 52. 

[60i As discussed above and further below, where the pipeline circuit 80 is 

a PL! C, the firmware memory 52 stores the flmnware that represents one or more 
sets hard configurations of the pipeline circuit The firmware memory 52 includes a 
test port 104 and programming and configuration ports WO and 108, The test 

1 0 port f 04, which is coupted to the test bus 63, allows the host processor 42 {FIG. 3) to 
monitor the results of a seif test that the firmware memory 52 may perform during 
initlalizatjon of the peer-vector machine 40 (FIG. 3) as discussed befow. Also as 
discussed below, the test port 104 may aiiow the host processor 42 to load firmware 
into the memory 52. The manufarfure typically includes the test port f 04 with the 

1 5 memory 52, and typical fy provides the test port with an interfece (not shown) that m 
compatible with an industry-standard test protocof such as JTAG. The programming 
port 100, which is ooupied to the programming port 94 of the communication 
interface 82 via a programming bus 110, allows the pipeline circuit BO to bad 
firmware into the memory 52 as discussed below. And the hard-configuration port 

20 108, which is coupled to the hard-configuration port §8 of the pipeline circuit SO via a 
configuration bus 112, allows the pipeline circuit to download firmware from the 
memory 52 as discussed below. Typically, the firmware memory 52 Is a nonvolatile 
memory such as an EEPROM, which retains data In the absence of power. 
Consequently, the fimiware memory 52 continues to store the firmware after the 

25 pipeline unit 78 is powered down. 

[611 Stjf! referring to FIG. 4, although the firmware memory 52 and the data 

memory 81 are described as being externa! to the pipeline circyit 80, either or both 
memories may be tncorporated into the pipeline circuit. Where the memory 52 is 
disposed inside of the pipeline circuit 80, a designer may need to modify the 
30 structures of the programming and configuration busses 110 and 112 accordingly- 
Furthermore, although the pipeline unit 78 is described as having a programming 
bus f to that is separate from the configuration bus 112, a singfe bus (not shown) 
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may perform the ftinctions of both the programming and configuration busses. 
Altemativeiy, the pipeline unit 78 may include multiple instances this single bus, or 
multipie instances of one or both of the programming and configuration 112 and 110. 

|62| FIG- 5 is a diagram of a logical partitioning of the firmware memory 52 

5 of FIG. 4 according to an embodiment of the invention. 

|63] A section 114 of the memory 52 stores firmware that represents an 

initial configuration of the pipeline circuit 80 (FJG« 4). That is, when downtoaded to 
the pipeline circuit SO, this firmware causes the pipeline circuit to have the jnitiai 

Gonfiguratton. In one impiementation of the initial configuration, the pipeline circuit 
10 80 includes the communication interface 82 (and the industry-standard bus interface 
91 i1 needed) of FIG. 4 and seif4eat circuitry (not shown) that executes a self test of 
the pipeline circuit and the data memory 81. The pipeline circuit 80 can then pnovide 
the results of the self test to the host processor 42 (FIG. 3) via the test bus 63 or the 
communication interface 82. The initial configuration also ailows the host processor 
15 42 to load modified firmware into the firmware memory 52 via the Gommunlcation 
interface 82 and Ihe programming bus 110 as discussed below* 

[64] Sections 116i—1 f 6/ of the memory 52 each store firmware that 

represents a respective operating configuration of the pipeline circuit 80, Typically, 
the pipeline circuit 80 downloads the firmware from a predetermined one of the 

20 sections 116i - f f 6/ at the end of the Initiafization of the accelerator 44 (FIG* 3). As 
discussed below, the pipeline circuit SO may be preprogrammed to download 
firmware from a partlcuiar section 11$^ - 116^^ or the host processor 42 (FfG. 3) may 
instryct the pipeline circuit to download the fimiware from a particular section. 
Typically, m each of the / operating configurations, the pipeline circuit 80 inciudes the 

25 Gomponents {e.g., hardwired pipelines 74i - 74n. controller 86) shown in FIG, 4, But 
in each of these corrflgurations, the pipeline circuit 80 typrcaiiy operates a differentJy. 
For example, the communication interface 82 may implement one protocol in one 
configuration and another protocol in another configuration. Or, the pipelines 74i - 
74n may perform one set of operations on data in one configuration and perform 

30 another set of operations on the data in another configuration. 

[65] Optional section 118 stores a description or identification of the 

operating configurations respectively represented by the firmware stored in the 

17 
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sections f f 6f - 116f of the memory 52, This description/ideritificatSon aliows the host 
processor 42 (FIG. 3) to identify the firmware stored in the memory 52. 

[66] Optional section 120 stores a profile of the pipeline unit 78 (FIG, 4). 

The profife typlcaily describes the hardware layout of the pipeline unit 78 suffideniy 
for the host processor 42 (FIG. 3) to appropriately configure itself, the pipeline unit, 
and other peers (not shown) of the peer-vector machine 40 (FIG, 3) for 
intercommunication. For example, the profife may identify the data operations and 
communJcation protocols that the pfpefine unit 7S is capable of implementing, the 
size of the data memory 81, the operating configurations represented by the 
firmware stored in sections 116i - 116} (if the section 118 is omitted), and a oirrentiy 
desired operating configuration. Consequently, by reading the profile during 
initiaiization of the peer-vector machine 40, the host processor 42 can properly 
configure the message handier 64 (FiG« 3) to communicate with the pipeline unit 78. 
Furthermore, the host processor 42 may select the section f f 6f - 116i of firmware 
that the pipeline circuit 80 should downioad. Or, if none of this firmware is suftabfe, 
the host processor 42 may load modified firmware into the memory 52. This 
technique is analogous to the "plug and piay" technique by which a computer can 
configure itself to communicate with a newiy installed periphera} such as a disk drive. 

|673 Alternatively, the section 120 may store a profile identifier — often 

called a "running index^ — that alfows the host processor 42 (FIG. 3) to retrieve the 
profile from a tabfe that is stored in, e.g., the accelerator configuration registiy 70 
(FIG. 3). The running index is typically a number, much like a model number of a 
product, which the host processor 42 can match to a stored profile. 

[68] f n yet another alternative, the pipeHne unit 78 (FIG. 4) may store the 

profile identifier in a "hardwired'' form to eliminate the chance that one may 
inadvertentiy overwrite the profile in the section 120. For example, the pipeline unit 
78 may store the profile identifier in a hardwired "register" that the host processor 42 
(FIG. 3) can read via the test bus 63, or via the pipeline bus 50 and the pipeline 
circuit 80 (FIG. 4). This register may be formed from, eg., electro-mechanical 
switches, Jumpers, or soldered connections (not shown). 
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|69] Still referring to FIG. S, optional section 122 of the firmware memory 52 

may store misceHaneous data, such as a seff-test routine thattlie fimiware memory 

52 runs during initialization of the acoeferator 44. 

{70} Referring to FIGS* 3 - 5, the operation of the peer-vector machine 40 

5 — particularly the operation of the host processor 42, pipeline circuit 80, and 
firmware memory 52 — ?s discussed below according to an embodiment of the 
invention. 

[71 1 When the peer-vector machine 40 is first powered on, the host 

pmcessor 42 initializes itself as discussed In previously cited U.S. Patent App, Seria! 

10 Ho. 10/684,053 entitled COlVIPUTtNG MACHINE HAVING IMPROVED 

COMPUTING ARCHITECTURE AND RELATED SYSTEM AND METHOD, and the 
accelerator 44 partially mitiaifees itseit More specificayy, during this partial 
initiaiization, the pipeline circuit 80 downloads the initial-configuration firmware from 
the section 114 of the memory 52. As discussed above, in the initial configuration, 

15 the pipeline circuit 80 incfudes at least the communication interface 82 and test 
circuitry (not shown). After the pipeline circuit 80 is oanfigured in the inttta! 
configuration, the test circuitry performs a self test of the pipeline drcuit and the data 
memory 81, and provides the results of the self test to the host processor 42 via the 
test port 96 and the test bus 63, The firmware memory 52 may also perform a self 

20 test and provide the results to the host pracessor 42 via the test port 104 and the test 
bus 6$ as discussed above in conjunction with FIG* 5* 

f72] Next, tSie host processor 42 determines if an exception occurred during 

the partial initialization of the acceierator 44. For example, the host processor 42 
anaiyzes the seif-test results from the test bus 63 to determine whether the pipeline 
25 circuit 80, the data memory 81, and the firmware memory S2 are ftinciioning 
properly. 

[73} If an exception did occur, then the host processor 42 handles it in a 

predetemfiined manner For example, If the host processor 42 does not receive a 
self-test result from the pipeline circuit 80, then it may check, via the test bus 63, 
30 whether the initiaJ-configuration firmware is stored in the section 114 of the firmware 
memory 52. ff the initiaf-oonfiguration firmware Is not stored, tiien the host processor 
42 may load the initiat-configuration firmware into the section 114 via the pipeline 
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bus 50 or the test bus 55, cause the pipeline circyit 80 to download this firmware, 
and then analyze the result of the seif test The host processor's handling of 
exceptions is further discussed in previously cited U.S. Patent App. Serial No. 
10/684,063 entitfed COyPUTlNG MACHINE HAVING tMPROVED COMPUTiNG 
5 ARCHITECTURE AND RELATED SYSTEM AND METHOD. 

[74] If no exception occurred, then host processor 42 reads the profile 

identifier from the pipeline unit 78, and subsequently obtains the corresponding 
profiie of the pipeline unit from the accelerator configuration registry 70. Obteining 
the pnsfile from the registry 70 instead of from the section f 20 of the firmware 

10 memory 52 is often preferred, because if the pipeline circuit 80 is an ASIC, then the 
pipefine unit 78 may not indude a nonvolatile memory such as the fimiware memory, 
{f the profile identifier indicates that the pipefme circuit 80 is an ASiC, then the host 
processor 42 determines that no fimrjware need be downloaded to the pipefine 
circuit. Alternatively, the host processor 42 (FIG. 3) may obtain the profile from the 

15 section 120 of the firmware memory 52. In this alternative, it is unnecessary for the 
pipeHne unit 78 to store a profile identifier, although the pipeline unit may store a 
profile identifier in case the profile is inadvertantly deleted from the section 120. 

|75] NoTd, after reading the profile identifiers from ail of the pipeline units 78 

(only one shown in FIG. 4), the host processor 42 effectively generates a map of all 
20 the pipeline units 78 in the accelerator 44, and stores this map, e.g., in the handier 
memory 68. 

|76I Then, for each pipeline unit 78, the host processor 42 extracts from the 

profile the identity of the desired operating configuration of the pipetine circuit 80. 
Extracting the desired operating configuration during initiailzation of the acceierafor 
25 44 allowB one to modify the operation of the pipeline circuit 80 by merely updating 
the profiie prior to the initialization, 

[77| Next, the host processor 42 detennines whether the firmware that 

represents the desired operating configuration is stored in the firmware memory 52. 
For example, the host processor 42 can read the configyration description from the 
30 memory section 118 via the programming bus f f 0 and the communicatfon interface 
82 — because the pipeline circuit 80 is in the initial configuration, the commonication 
interface is present — to determine whether the desired firmware is stored in any of 

20 
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the sections 116i - f f S/, Aiternativefy, the host processor 42 may read the 
configuration description directly from the memory 52 via the test bus 63 and the test 
port 104. 

[781 If the firmware that represents the desired operating configuration is 

5 not stored in the firmware memory 52, then the host processor 42 toads this firmware 
from the acoeierafor configuration registry 70 into one of the sections f t6t - 11 Of of 
the firmware memory via the communication interface 82, the programming ports 94 
and 10$, and the programming bus 110. If the firmware is not in the registry 70, then 
the host processor 42 may retrieve the firmware from an external library (not shown )> 
10 or may generate an exception indicator so that a system operation (not shown) can 
ioad the firmware into the regist^ 70. 

[793 Next, the host processor 42 instructs the pipeline circuit 80 to download 

the desired finmware from the corresponding section 116i- 11$^ of the memory 52 via 
the port 108, the configuration bus 112, and the port 98, 

1 5 [80] After the pipeline circuit 80 downloads the desired firmware, it is in the 

desired operating configuration and is ready to begin processing data. But even 
afterthe pipeline circuit 80 is in its desired operating configuration » the host 
processor 42 may load new firmware into the sections 116i - 116} of the memon^ 52 
via the communication interface 82 or via the test bus 03. For example, to ioad new 

20 firmware, the host processor 42 may first cause the pipeline circuit SO to re toad the 
firmware from the sectioo 114 of the memory 52 so that the pipeSine circuit is again in 
the initial configuration. Then, the host processor 42 loads the new firmware into 
one of the sections 116i - 116f via the pipeOne bus 50 and the communication 
interface 82. Next, the host processor 42 causes the pipeline circuit 80 to download 

25 the new firmware so that the pipeline circuit is in the new operating configuration. 

Allowing the pipeline circuit 80 to load new firmware into the memory 52 only when in 
the inltia! configuration provides two advantages. First, it prevents the pipeline circuit 
80 from inadvertentfy altering the firmware stored in the memory 52 when the 
pipeline circuit is in an operating configuration. Second, it aiiows the operating 

30 configurations to utilize resources of the pipeilne circuit 80 that woufd otherwise be 
used for the circuitry needed to write firmware to the memory 52. 
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[811 Fig. 6 Is a block diagram of a pipeline unit f 24 of the pipeline 

acceierator 44 of FIG. 3 according to anottter emixxJiment of invention. 

[823 The pipeline unit 124 is simiiar to the pipeline unit 78 of FIG, 4 except 

tiiat the pipeline unit 124 inciudes multiple pipeline circuits SO — here two pipeline 
circuits 8Qa and 80b — and multiple firmware memories — here two memories S2a 
and 52t>, one memory for each pipeline circuit The ccwnbination of the pipeline 
circuits 80a and 80b and the firmware memories 02a and S2b forms a 
programmable-circuit unit In one implementation, each of flie memories 52a and 
52b is partftioned as shown in FIG. S, except that the firmware memory 52b may 
omit the secfeon 120, which stores the profile of iJie pipeline unit 124 and whidi 
otherwise would be redundant vwth the section 120 of the memory 52a. 
^temativeiy, the pipeline circuits SOa and 806 may share a single firmware memory 
that Includes respective sections that are operatlveiy similar to the memories 52a 
and S2b. increasing the number of pipeline circuits 80 typically allows an increase in 
the number n of hardwired pipelines 74i-74„, and thus an increase in the 
functionaiity of the pipeline unit 124 as compared to the pipeline unit 78. 
Furthermore, either one or both of the pipeline circuits 80a and 80b may be an ASIC, 
in which case the corresponding firmware memoryOes) 52 may be omitted. 

[833 Further details of the structure and operation of the pipeline unit 124 

are discussed In previously cited U.S. Patent App. Serial No. 10/683,929 entitled 
PIPELINE ACCELERATOR FOR IMPROVED COyPUTING ARCHITECTURE AND 
RELATED SYSTEM AND METHOD. 

[S4I The pipeline circuit 80a includes a test port 98a and a hard- 

configuration port ma, which are respectivety simitar to the test port 96 and hard- 
configuration port 98 of FIG. 4. And l!!<e the pipeline circuit 80 of FIG. 4, the pipeline 
circuit 80a includes the communication Interface 82 having the programming port 54. 

£85] The pipeline circuit 80b inciudes a test port 98b and a hard- 

configuration port 08b, v\^ich are also respectively similar to the test port 96 and the 
hard-configuration port 08 of FIG. 4, And because the host processor 42 (FIG. 3) 
can program the firmware memory S2b via the communication interface 82 of the 
pipeline circuit 80a as discussed below, the pipeline circuit SOib does not include a 
programming port, 
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[86] The firmv\^re memory 52a includes test, prcjgramming, and 

hard-configuration ports 104a, 1060, and 108a, which are respectivefy similsir to the 
test, programming, and hard-configuration ports 104, 100, and 108 of FIG. 4. The 
test port 104a is coupied to the test bus 63, the programming port 106a is coupled to 
6 the programming port 94a of the communication interface 82 via the programming 
bus 110, and the hard-configuration port 108a is coupied to the hard-configuration 
port 98a of the pipeline circuit 80a via a configuration bus 112a, 

[87] Likewise, the firmware memory 52b indudes test, programming, and 

hard-configuration ports 104b, 106b, and 108b, wrtilch are respectiveiy simiiar to the 
10 test, programming, arKJ hard-configuration ports 104, 106, and 108 of FIG. 4. The 
test port 1Q4b is coupled to ttie test bus €3, the programming port 106b Is coupled to 
the programming port 04& of the communication interface 52 via the programming 
bus 110, and the hard-configuration port lOBb is coupied to the hard-configuration 
port QBb of the pipeline circuit 8Qb via a configuration bus 112b. 

1 5 [88] Referring to FIGS. 3, 5 and 6, the operation of the peer-vector machine 

40 — particularly the host processor 42, the pipeline ciroiits 8Qa and 80b, and the 
firmware memwies 52a and S2b ™ is discussed below acconjing to an embod&nent 
of the invenUon, 

£89] When the peer-vector machine 40 Is itrst powered on, the host 

20 processor 42 iniiiaiizes itself as discussed In previously cited U.S. Patent App. Serial 
No. 10/684,053 entitled COMPUTING MACHINE HAVING IMPROVED 
coy PUT! NG ARCHITECTURE AND RELATED SYSTEM AND METHOD, and the 
accelerator 44 partiafly initializes itself. More specfficaliy, during this partial 
initialization, the pipeline circuits 80a and 80b download Initial-configuration firmware 
25 from the sections 114a and 114b of the firmware memones 52a and 526, 

respectively, in the respective initial configurations, the pipeline cirojlt 80a includes 
at least the communication interface 82 and test circuitry (not shown), and the 
pipeline circuit 80b Indudes at least test circuitry (not shown). After the pipeline 
circuits 80a and 80b are configured in their respective initial conftguraflons, the test 
30 circuit within each pipeline circuit performs a respective self test of the pipeline circuit 
— the test circuitry of one or both of the pipeline circuits 80a and 80b may also test 
the data memory 81 — and pro\«des the results of these self tests to the host 
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processor 42 vja the test ports 96a and 96b, respectively, and the test bus B3. The 
firmware memories 52a and 52b may aiso perform respective self tests and provide 
the resuits to the host processor 42 via the test ports f 04a and 104b, respectively, 
and the test bus 63 as discussed above in conjunction with FIG. 6, 

[90] Next, the host processor 42 determines if an exception occun^ed during 

the partial initiaHzation of the aoceierator 44. For example, the host processor 42 
analyzes the self-test resuits from the test bus 63 to determine whether the pipeline 
circurts 80a and 80b, the data memory 81, and the firmware memories S2a and 52b 
are functioning properly, 

[913 exception did occur, then the host processor 42 handles it in a 

predetermined manner For example, if the host processor 42 does not receive a 
self-test result from the pfpeline oircuit 80a, then it may check, via the test bus 63, 
whether the initiat-configuration firmware is stored In the section ff 4a of the firmware 
memory 52a. If the fnitial-configuratlon firmware is not stored, then the host 
prooessor 42 may toad the iniiai^onfiguration firmware Into the section 114a, cause 
the pipeHne circuit 80a to downtoad this firmware, and then anaiyze the result of the 
self test This example aiso applies to the pipeline circuit SOb and the firmware 
memory 52b. The host processor's handling of exceptions te further discussed in 
previously cited U.S. Patent App, Serial No, 10/684,053 entitled COMPUTING 
MACHINE HAVING IMPROVED COMPUTING ARCHITECTURE AND RELATED 
SYSTEM AND METHOD, 

|92] tf no exception occurred, then the host processor 42 reads the prof lie 

Identifier from the pipaSine unit 124, and subseqyentiy obtains the corresponding 
profile of the pipeline unit from the accelerator configuration registry TO or from the 
section f 20 of the firmware memory 52a as discussed above m conjunction with FIG. 
4. 

1933 Next, after reading the profile identifiers from all of the pipeiine units 

124 (only one shown m FIG. 4), the host processor 42 effectiveiy generates a map of 
afJ the pipefrne units in the accelerator 44, and stores thts map, e.g., in the handler 
memory 68. 
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[94j| Then, the host processor 42 extracts from the fwofif© the identities of 

the desired operating conflguratioris of Uie pipeline cirtjuits 80a and 80b. Extracting 
the desired operating configurations during initlaiization of the accelerator 44 allows 
one to modify the operation of the pipeline circuit SOa and/or 80b by merely updating 
the profile prior to the initiaiization, 

[95] Next, the host processor 42 determines whether the firmware that 

represents the desired operating configurations is stored In the firmware memories 
52a and S2b. For example, the host processor 42 can read the configuration 
description from the memory section 118a of the memory 52a via the programming 
bus 110 and the communication interface 82 — because the pipeline circuit 80a Is in 
the initial configuration, the communication interface is present — to determine 
whether the desired firmware is stored in any of the sections f f 6ai - f f 
Alternatively, the host processor 42 may read the configuration description directly 
from the memory 52a via the test bus 03 and the test port 104a. This example also 
applies to the pipeline circuit SOb and the firmware memory S2b. 

{96| If the firmware that represents one or both of the desired operating 

configurations is not stored In the firmware memories 52a and/or 52b, then the host 
processor 42 loads this fimnware from the accelerator configuration registry 70 into 
one of the sections 11 6i - f f 6/of the appropriate finnware memory via the 
communication Interface 82, the programming ports 94 and 106, and the 
programming bus 110, For example, if the firmware that represents the desired 
operating configuration of the pipeline citxiuit SOb is not stored in the memory S2b, 
then the host processor 42 loads Sils firmware from the registry 70 into one of the 
sections 1i0b^ - llObi via the Interface 82. programming ports 94 and lOSb, and the 
programming bus 110. If the firmware is not in the registry 70, then the host 
processor 42 may retrieve the firmware from an external Hbrary {not shown), or may 
generate an exception indicator so that a system operator (not shown) can load the 
firmware into the registry 70. 

[07] Next, the host pnscessor 42 instructs the pipeline ciraiit 80a to 

download the desired firmware from the cormspondfng sections 116a<- llOai of the 
memory 52a via the port 108a, the configuration bus ff 2a, and the port 98a, and 
inslHicts the pipeline clraiit SOb to download the desired firmware from tiie 
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corresponding sections f f 661 - iiBb{ of the memory 52fc via the port iOBb, the 

configuration bus ff 2&, and the port 98b. 

[9S3 After the pipeHne Circuits 80b and 80b download the desired firmware, 

they are in the desired operating configurations^ and are ready to begin processing 
data. But even after the pipeime circuits 80a and 80b are in their desired operating 
configurations, the host processor 42 may toad new firmware into the sections f f 6f - 
i 16i of the memories S2a and S2b via the communication interface 82 or via the test 
bus 63 in a manner simiiar to that discussed above in conjunction with FiG. 4, 

[991 The preceding discussion is presented to enable a person skllted in the 

art to make and use the inventton. Various modifications to the embodiments wiil be 
readily apparent to those skilled in the art, and the generic principles herein may be 
applied to other embodiments and applications ufithout departing from the spirit and 
scope of the present invention. Thus, the present invention is not intended to be 
limited to the embodiments shovs/n. but Is to be accorded the widest scope consistent 
with the principies and features disclosed herein. 
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WHAT IS CLAIMED IS: 

1 . A programmable circuit operabie to: 

receive firmware from an axternaf source, the firmware representing a 
configuratton; 

store the firmware In a memory; and 
downioad the firmware from the memory. 

2. The programmable circuit of daim 1 , ftirther operable to operate m the 
configuration after down bad ing the firmware from the memory. 

3. The programmable circuit of claim 1 wherein the memory comprises a 
nonvoiatile memory, 

4. The programmable circuit of cfaim 1 wherein the memory cx>mprfses an 
externa! memory. 

5. A programmable circuit operable to: 

download from a memory first firmware that represents a first configuration; 
operate in the first configuration; 

download from the memory second firmware that represents a second 
configuration; and 

operate in the second configuration. 

6: The programmable circuit of claim 5 wherein the programmable circuit 
is fur&ier operable to; 

receive the second firmware from an external source while operating in the 
first configuration; and 

storing the second firmware in the memory while operating in the first 
configuration- 

7. A programmable-circuit unit comprising: 
a memory; and 

a programmable circuit coupled to the memory and operable to, 

receive firmware from an external source, the firmware representing a 
configuration of the programmabfe circuit, 

store the firmware in the memory, and 
download the firmware from the memory. 
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8. The programmabfe-circuit unit of daim 7 wherein the memory 
comprises an eiectricafly erasable and programmable read-only memory. 

9. The programmable-drcurt unit of cfaim 7 wherein the programmable 
circuit comprises a field-programmable gate array, 

10. A programmable-circuit unit, comprising: 

a memory operable to store first and second firmware data that respectively 
represent first and second configurations; and 

a programmable circuit coupled to the memory and operable to, 

download the first firmware from the memoiy, 
operate in the first conHguraion, 
download the second firmware from the memory, and 
operate in the second configuration. 

1 1 * The programmable-circuit unit of claim 1 0 wherein the programmable 
circuit is further operable to: 

receive the second firmware from an externai source while operating in the 
first configuration; and 

store the second firmware in the memory while operating in the first 
configuration. 

12. The programmable-oircuit unit of cfaim 10 wherein the programmabie 
circuit is operable to load the second firmware while operating in the first 
configuration. 

13. A programmabie-circuit unit, comprising: 

a memory operable to store first, second, third, and fourth firmware that 
respectively represent first, second, third, and fourth configurations; 

a first programmabie circutt coupled to the memory and operabie to, 
download the first firmware from the memory* 
operate in the first configuration, 
download the second firmware from the memory, and 
operate in the second configuration; and 
a second programmable circuit coupied to the memory and to the first 
programmable circuit and operable to^ 
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download the third firmware data from the memory, 
operate in the third configuratton, 
download the fourth firmware from the memory, and 
operate in the fourth configuration. 

14* The programmable-drcuit unit of claim 1 3 wherein the first 
programmable circuit is further operable to: 

receive the second and fourth firmware from an external source whiie 
operating in the first configoratton; and 

store the second and fourth firmware in the memory while operating in the first 
configuration. 

1 5, The programmabte-drcuit unit of claim 13 wherein the first and second 
programmable circuits comprise respective fleld-programmabie gate arrays. 

16, A computing machine, comprising: 
a processor; and 

a programmable-cin:)uit unit coupled to the processor and comprising, 
a memory, and 

a programmable circuit coupled to the memory and operable to, 
receive from the processor firmware that represents a coniguration of 
the programmable drouit, 

store the firmware in the memory, and 

download the firmware from the memory in response to the 

processor, 

17. The computing machine of claim 16 wherein the processor is operable 

to: 

before sending the firmware to the programmabie circuit determine 
whether the firmware is already stored in the memory; and 

send the firmware to the programmable circuit only if the firmware is 
not alfBady stored in the memory* 

18. The computing machine of ciaim 16, further comprising: 
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a configuration registry coupfed to the processor and operabte to store 
the firmware and to indicate that the firmware represents a desired 
configu ration for the programmable circuit; end 

wherein the processor is operable to download the firmware from the 
conftguratjon registry to the programmabfe circuit 

19. The computing machine of claim 16, wherein: 

the programmable-circuit unit comprises a pipeline unit; and 
the programmable circuit incfudes a hardwired pipeiina that is operable 
to operate on data, 

20. A computing machine, comprising: 
a processor; and 

programmable-circuit unit coupled to the processor and comprising, 

a memory operabia to store first and second firmware that respectiveiy 
represent first and second configurations; and 
a programmable circuit operable to, 

download the first firmware from the memory, 
operate in the first configuration, 

download the second firmware from the memory in response to 

the processor, and 

operate In the second configuration. 

21 , The computing machine of ciaim 20 wherein: 
the processor comprises a first test port; 

the programmabla^circuit unit comprise a second test port that is coupled to 
the first test port; and 

the processor is operable to toad the first firmware into memory via the first 
and second test ports. 

22, The computing machine of claim 20 wherein: 
the processor comprises a first test port; 

the programmabie-circuit unit comprise a second test port that is coupled to 
the first test port; 
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while operating in the first configuration, the programmabie drcuil is operabie 
to perform a seif last and to provide self-test data to the processor via the first and 

second test ports; and 

the processor Is operable to cause the programmable circuit to download the 
second firmware from memory only if the self-test data indicates a predetermined 
resuit of the self test 

23- The computing machine of daim 20 wherein; 

the processor is operable to send the second firmware to the programmable 
circuit; and 

while operating in the first configumtion, the programmable circuit is operable 
to load the second firmware into the memory in response to the processofc 

24, A computing machine, comprising: 
a processor; and 

programmabfe-drcuit unit coupled to the processor and comprising, 

a memory operable to store first, second, third, and fourth firmware that 
respectively represent first, second, thifd, and fourth configurations, 

a first programmable circuit coupled to the memory and operabie to, 
download the first firmware from the memory » 
operate in the first configuration, 

download the second frmwafB from the memory in response to 

the processor, and 

operate in the second configuration, and 
a second programmable circuit coupfed to the memory and to the first 
programmable circuft and operable to, 

downioad the third firmware from the memory, 
operate in the third configuration, 

download the fourth firmware from the memory in response to 

the processor, and 

operate in the fourth configuration. 

25. The computing machine of claim 24 wherein: 
the pn^cessor comprises a first test port; 
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the program mable-circutt unit comprise a second test port that is coupted to 
the first test port; and 

the processor Is operable to load the first and third firmware into memory via 
the first and second test ports. 

26. The computing machine of claim 24 wherein: 
the processor comprises a first test port; 

the programmabie-circuit unit comprise a second test port that is coupled to 
the first test port; 

while operating in the first configuration, the fir^t programmable circuit is 
operabie to perform a first self test and to provide first self-test data to the processor 
via the first and second test ports; 

while operating in the third configuration, the second programmable circuit is 
operable to perform a second seff test and to provide second self-test data to the 
processor via the first and second test ports; and 

the processor is operable to cause the first and second programmable 
circuits to respectively load the second and fourth firmware from the memory only if 
the first and second self-test data indicate respective predetermined results of the 
first and second self tests* 

27. The computing machine of claim 24 wherein: 

the processor is operable to send the second and fourth firmware to the first 
programmable circuit; and 

white operating in the first configuration, the first programmable circuit Is 
operable to load tie second and fourth fimiware into the memory in response to the 
processor. 

28, The computing machine of claim 24 wherein the memory comprises: 

a first memory section coupled to the first programmable circuit and operabie 
to store the first and second firmware; and 

a second memory section coupted to the first and second programmable 
circuits and operable to store the third and fourth firmware. 

29, The computing machine of claim 28 wherein the first and second 
memory sections are respectively disposed on first and second Integrated circylts. 
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30. A method, comprising: 

providing firmware to a programmable circuit, the fimiware represarjting a 
configuration of the drcuit; 

storing the configuration data in a memory with the programmable circuit; and 
downloading the configuration data from the memory into the programmable 

circuit. 

31 . The method of claim 30, further comprising operating in the 
configuration after downloading the configuration data from the memory, 

32. A method, comprising: 

downloading into a programmable circuit first firmware that represents a first 
configuration; 

operating the programmabla circuit in the first configuration; 

downloading into the programmabie circuit second firmware that represents a 
second configuration; and 

operating the programmabie circuit in the second configuration after 
downbadtng the second firmware. 

33. The method of claim 32 wherein downloading the second fimiware 
comprises: 

sending the second firmware to the programmabla circuit; 
foading the second firmware Into a memory with the programmabSe circuit 
while the programmabie circuit is operating in the first configuration; and 

downfoading the second firmware from the memory into the programmable 

circuit. 

34. The method of claim 32 wherein downloading the second firmware 
comprises: 

determining whether the second firmware is stored in a memory coupled to 
the programmabie circuit; 

sending the second fimnware to the programmabie circuit only if the second 
firmware is not stored in the memory; 

loading the second firmware into the memory with the programmabie cirouit 
while the programmable circuit is operating in the first configuration; and 
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downioading the second firmware from the memory into the programmable 

circuit. 

35. The method of claim 32 wherein: 

operating the programmable circuit in the first configuration comprises testing 
the programmable circuit; and 

downloading the second firmware comprises downloading the second 
firmware only if the programmabfe circuit passes the testing, 

36. A method, comprising: 

downloading first and second firmware into first and second programmabie 
circuits, respectively; 

operating the first and second programmable circuits in the first and second 
configurations, respectivaty; 

downloading third and fourth firmware into the first and secx)nd programmable 
circuits, respectively, via the first programmabte circuit; and 

operating the first and second programmabie circuits In the third configuration 
and fourth configurations, respeotivefy. 

37. The method of claim 36 wherein downloading the first and second 
firmware comprises downioading the first and second firmware into the first and 
second programmabfe circuits, respactively, via a test port. 

38. The method of daim 36 wherein: 

operating the first and second programmable circuits in the first and second 
configurations comprises testing the first and second programmable circuits; and 

loading the third and fourth firmware into the first and second programmable 
circuits comprises, 

loading the third firmware only if the testing indicates that the first 
pnogrammabla circuit is functioning as desired, and 

loading the fourth flmiware only if the testing indicates that the second 
programmable circuit is functioning as desired. 
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